Electron-hole pairing in topological insulator thin film 
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We consider pairing of massless Dirac electrons and holes located on opposite surfaces of thin 
film of "strong" three-dimensional topological insulator. Such pairing was predicted to give rise 
to topological exciton condensate with unusual properties. We estimate quantitatively achievable 
critical temperature of the pairing with taking into account self-consistent screening of the Coulomb 
interaction, disorder and hybridization of electron and hole states caused by a tunneling through 
the film. Increase of the gap above the hybridization value when the temperature is lowered can be 
observable signature of the pairing. System parameters required to observe the electron-hole pairing 
are discussed. 

PACS numbers: 71.35.-y, 73.20.-r, 73.22. Gk 



I. INTRODUCTION 

Research of nontrivial topological states of matter was 
highly stimulated in recent years by discovery of two- 
and three-dimensional topological insulators (TIs) [l], Q ■ 
Nonzero topological invariant characterizing global topol- 
ogy of filled electron states in Hilbert space across the 
whole Brillouin zone distinguishes TI from a trivial in- 
sulator. One of the most interesting properties of TI is 
the existence of gapless topologically protected edge (in a 
two-dimensional case) or surface (in a three-dimensional 
case) electron states. 

Unusual properties of surface modes manifest them- 
selves most strikingly in second generation of "strong" 
three-dimensional TIs represented by such materials as 
Bi 2 Se 3 , Bi 2 Te 3 , Sb 2 Te 3 , Bi 2 Te 2 Se and others 0-0- In 
these materials band structure of the surface states con- 
tains a Dirac cone, and electrons obey a two-dimensional 
Dirac- Weyl equation for massless particles in the vicin- 
ity of a Dirac point. Electrons in graphene demonstrate 
similar properties but have two inequivalent Dirac cones 
and additional two-fold degeneracy by spin projections 
0. 

Gap in a spectrum of the surface states can be induced 
when the time-reversal symmetry is broken b y m agnetic 
impurities or in proximity to a ferromagnet [8l-ll0l] . When 
the gap is opened in such a way on the whole surface 
of TI, the spectacular topological magnetoelectric effect 
arises [13, EJ • Another way to open the gap is to break 
the gauge symmetry by a contact with superconductor, 
when the surface of TI acquires the properties of topolog- 
ical superconductor |12| . Intrinsic Cooper pairing involv- 
ing surface Dirac electrons induced by some mechanism 
can also lead to analo gue of topological superconductiv- 
ity on a surface of TI [13- 15]. 

Such "strong" three-dimensional TIs as Bi 2 Se3, Bi 2 Te3 
etc. have layered crystal structure [3, H| with each layer 
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consisting of five atomic layers (quintuple layer, QL) and 
having a thickness of about 1 nm. Fabrication of thin 
films of these materials with arbitrary thickness, down 
to only one QL, was realized recently by means of epi- 
taxial methods [l6T - fl9l ]. by vapor-solid growth [20[ and 
by mechanical exfoliation |2lT - l23l ]. Electronic properties 
of TI thin films are strongly affected by a tunneling be- 
tween opposite surfaces giving rise to a hybridization gap 
[lH I24T--29] and other observable phenomena, for exam- 
ple, unusual spin arr ang ement and splitting of the zero- 
energy Landau level [3014331 ]. 

Chiral electrons on opposite surfaces of TI film con- 
stitute a strongly-coupled bilayer system which, in prin- 
ciple, can demonstrate various coherent quantum phe- 
nomena. In the case of antisymmetric doping of these 
surfaces, one can realize a Coulomb-interaction mediated 
pairing of electrons on one surface of the film and holes 
on the opposite surface [33 - I44T ]. analogous to that pro- 
posed earlier for massive electrons and holes in coupled 
semiconductor quantum wells [45rj4c| . and for massless 
Dirac electrons and holes in graphene bilayer (49l - [58j . 
This kind of pairing is similar to Cooper pairing of elec- 
trons in superconductors but occurs between spatially 
separated electrons and holes. 

Although graphene, owing to its monoatomic thick- 
ness, allows to fabricate two-layer structures with record 
small interlayer distance and demonstrates high carrier 
mobilities Q, four- fold degeneracy of its electron states 
leads to very strong screening of the pairing interaction 
and thus to rather low critical temperatures [53l [55[ . In 
the case of TI films, predictions for critical temperature 
of the pairing can be much more optimistic since electron 
states there have no degeneracy, as noted in [34], [H, [4l[ . 

Besides the weaker screening, the pairing in TI films 
could be more interesting from the viewpoint of the su- 
perfluid properties of resulting topological "exciton" con- 
densate. Zero-energy Majorana modes bound to vortex 
cores, gapless states on a contact with superconductor 
and other interesting phenomena were predicted in such 
system [3414361 l42l |43| . However whether the electron- 
hole pairing is achievable in TI films in practice is not 
yet known. Critical temperature for the superfluid state 
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about 100 K was estimated in [38|, |43[, however, with- 
out taking into account the screening. In approximation 
of separable potential, the critical temperatures up to 
0.1 K were obtained [39|]. The recent more complicated 
calculations including dynamical screening and correla- 
tion effects resulted in rather optimistic estimates (about 
100-200 K) for the zero-temperature gap [4l|. For the 
quantum Hall regime, gap s of the order of hundreds of 
Kelvins were predicted [371 ]. 

In our article, we study observable signatures of the 
electron-hole pairing in TI films in realistic conditions 
with taking into account interaction screening, hybridiza- 
tion and disorder. We start with description of the pair- 
ing in simple Bardeen-Cooper-Schrieffer (BCS) approxi- 
mation (section [TTJ) and show that the critical tempera- 
ture takes practically observable values (at least 0.1 K) 
only at film thickness less than 15 nm. Hybridization be- 
tween opposite surfaces significantly affects the pairing 
at such small thicknesses, as studied in section IIIII De- 
tection of the pairing against the background of strong 
hybridization becomes the major issue here. We show 
that increase of the gap due to the pairing as the temper- 
ature is lowered can be observed in TI films of moderate 
thickness of about 5-8 QL. 

Our study of suppression of the pairing by disorder 
in section IIVI shows the pairing requires rather high car- 
rier mobilities to be observable. In section [V] we demon- 
strate that the screening in a system with induced gap is 
suppressed in comparison with the metallic-like screen- 
ing assumed in the previous sections. By taking into 
account this correlation effect we find out that predicted 
gap greatly increases in moderately thin films. 

The calculations in this article refer to the case of 
Bi2Se3 films with 0.96 nm thickness of one QL [19j . How- 
ever our conclusions can be extended to other TIs of 
similar type with controlling parameters (Fermi veloc- 
ity, dielectric permittivity and hybridization gaps) close 
to those for Bi2Se3. 




FIG. 1: (Color online) TI film of thickness d and dielectric 
permittivity £2 surrounded by trivial insulators with permit- 
tivities si and £3. Electric potentials ±V on opposite surfaces 
of the film create electron and hole gases of equal concentra- 
tions. 



ment and by two-dimensional electron and hole gases on 
these surfaces. We consider the three-layer dielectric sys- 
tem (Fig. 1), where £2 is a dielectric permittivity of the TI 
film, £1 and £3 are dielectric permittivities of insulators 
above and below the film. In such system, the statically 
screened electron-hole interaction in the random phase 
approximation (RPA) is —V(q), where 



V(q) = 



4-Ke 2 
qD(q) 



£2 



47re" 

q 



ni2((?)sinh qd 



(1) 



(see also the similar formulas in [37J, |45j ) . Here 

D(q) = (£i£3 + £2) sinhgd + (£1 + £3^2 cosh qd 

Attp 2 

— [Su(g)IIii(g) + S 22 {q)n 22 (q) + 2£ 2 n 12 (g)] 

16tt 2 p 4 

+ — [n n (g)n 22 (g) - n? a (g)] anhqd, (2) 



II. BCS APPROXIMATION 

One of the possible setups for the pairing is depicted 
in Fig. Q] The opposite electric potentials ±V imposed 
on the opposite surfaces of the TI film either by gate 
electrodes or by appropriate contacts cause antisymmet- 
ric doping of these surfaces with electrons (top surfaces) 
and holes (bottom surface) up to the chemical potentials 
fi and — jj, respectively (Fig. [5]). For simplicity, we as- 
sume here the electron-hole symmetry. The alternative 
method to create electrons and holes can be based on 
chemical doping of the surfaces. 

The inverted structure "TI-insulator-TI" was also pro- 
posed by several authors [H, [H, |H, E2j |. but we shall 
demonstrate below that it is less suitable for the pairing. 

Coulomb interaction between electron and hole re- 
siding on opposite surfaces of TI film undergoes com- 
bined screening by three-dimensional dielectric environ- 





FIG. 2: (Color online) Band picture of the pairing: (a) the 
applied potential difference shifts energies of Dirac cones on 
opposite surfaces in opposite directions in such a way that 
electron and hole gases with chemical potentials /1 and —y, 
are formed; (b) the pairing opens the gap 2A on the Fermi 
level. 
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iSii (q) = £3 sinh qd + £2 cosh qd, 
S22 (q) — £1 sinh qd + 62 cosh qd, 



(3) 



Ilii(g) and 1122(9) are static polarizabilities of electron 
and hole gases on top and bottom surfaces of the film re- 
spectively, H\2{q) is the static anomalous interlayer po- 
larizability; d is the thickness of the film. 

We shall consider the pairing in the static approxima- 
tion, i.e. with neglecting frequency dependencies of a gap 
and pairing potential. At < q < 2p F the static polar- 
izab ility of Dirac electron or hole gas is Ho(q) = —gN 
[59l lopf . where g is the degeneracy factor, N — fi/2nVp 
is the density of states at the Fermi level, p F — fJ./v F is 
the Fermi momentum, v F is the Fermi velocity of Dirac 
electrons and holes (6.2 x 10 5 m/s for Bi 2 Se3 Q). 

In this section we assume that the screening is the 
same as in intrinsic system without pairing, setting Iln = 
II22 = IIo, II12 = 0. The main advantage of TI film over 
graphene bilayer is the smaller degeneracy factor g — 1 
(against g — 4 for graphene) providing a weaker screen- 
ing. 

The static dielectric permittivity of strong three- 
dimensional TIs is rather large (e.g., £2 ~ 80 for Bi2Se3 
fq~L| . £2 ~ 30 for Bi 2 Te3 (62|), which looks disappointing 
for realization of the pairing. However when the thickness 
of the film d is much smaller than the mean in-plane dis- 
tance between electrons and holes (of the order of Pp 1 ), 
electric field lines responsible for electron-hole interaction 
pass mainly through the media above and below the film. 
In this case the screening is the same as in homogeneous 
medium with the dielectric permittivity [e\ + £3)/2 and 
does not depend on the dielectric permittivity £2 of the 
film itself (it follows directly from the limit qd <C 1 of 
Eqs. and was also noted in [37j). 

Generally, the pairing of massless Dirac fermions can 
be multi-band, when the both valence and conduction 
bands of both layers are affected by the pairing correla- 
tions. The multi-band theory of the pairing in graphene 
bilayer provided larger estimates for the gap and criti- 
cal temperature than usual one-band BCS model both in 
static and dynamic approximations [54l - [56| . For the sake 
of simplicity, here we shall consider the pairing in one- 
band BCS model, being aware, however, that our results 
for gap and critical temperature can be underestimated. 

The integral BCS equation for the gap function A(p) in 
the one-band approximation is the following (analogously 
to that in Els 



A( P ) 



^l + cos^-yQ yn m 
(2tt) 2 2 



x^ltanh«, 



(4) 



where ip and ip' are azimuthal angles of the momenta 
p and p', entering the angular factor, specific to chiral 
Dirac electrons, E(p) — (v F p — y) 2 + | A(p)| 2 is the 
Bogolyubov excitation energy, T is the temperature. 

According to the usual BCS recipe, we assume that the 
gap is nonzero and constant in some energy region of the 




FIG. 3: (Color online) The coupling constant ([8| for the pair- 
ing in Bi2Se3 film with £2 = 80 as a function of ppd at 
ei = £3 = 1 (solid line), at £1 = £3 = 4 (dashed line) and 
for TI-vacuum-TI system with £1 = £3 = 80, £2 = 1 (dotted 
line). 



half-width w around the Fermi surface: 



A( P ) = 



0, 



if 
if 



\v F p 
\v F p- 



fi\ > w. 



Using Q-© we can find the gap at T = 



,BCS 



2we- 1 ' x 



and the critical temperature 

T _ 2we< 



-l/A 



(5) 



(6) 



(7) 



Here 7 w 0.577 is the Euler constant, A is the dimen- 
sionlcss coupling constant calculated as an average of in- 
teraction potential times the density of states over the 
Fermi surface: 



2tt 

. dip 1 + cos cp 
X 'to 2 



NV (2p F sin I 



(8) 



It is reasonable to take the pairing region half-width w 
of the order of the chemical potential /i, since there are no 
other energy scales in the system (in contrast to super- 
conductors, where w can be taken of the order of Debye 
frequency). Thus hereafter we take w = ji. The maxi- 
mal level of surface doping relative to the Dirac point in 
present three-dimensional TIs, being limited by a posi- 
tion of the bulk valence band, is about // « 0.1 eV [3J]. If 
we assume that the critical temperature ([7]) should be at 
least 0.1K for the pairing to be observable, then at the 
maximal w = fj, = 0.1 eV the coupling constant A should 
be not smaller than 0.14. 

The coupling constants in the cases of suspended 
Bi2Se3 film with e± = £3 = 1 and of the film surrounded 
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FIG. 4: (Color online) The BCS critical temperature of the 
pairing © in suspended Bi2Se3 film as a function of the chem- 
ical potential n at different film thicknesses d indicated near 
the corresponding curves. 



by a dielectric with ej = £ 3 = 4 are plotted in Fig. [3] 
at various p-pd. It is seen that in the both cases A falls 
off very rapidly with increasing ppd, and A > 0.14 re- 
quires p?d < 0.2. We see also that strong screening by 
TI bilk significantly suppresses the coupling constant in 
the inverted structure "TI-insulator-TI" even in the most 
favorable case of the vacuum spacer with £2 = 1. 

We can bring the coupling constant to its maximal 
value by approaching fi to zero and making the value of 
p^d arbitrarily small. But the preexponential factor in 
([7]), proportional to \x, also decreases in this case, thus we 
should not take too small /i in order to reach the highest 
T c . In Fig. S] we plot T c in a suspended Bi 2 Se3 film with 
£\ = £3 = 1 as a function of \x at different thicknesses 
d. It is seen that T c is maximal at some nonzero /1 de- 
pendent on d. In order to keep T c above 0.1 K we should 
take the film thickness d not exceeding 15 nm. The sim- 
ilar conclusion was made in I'A'.j . However in this case a 
tunneling between electron states on opposite surfaces of 
the film leads to significant hybridization of electron and 
hole states, which will be considered in the next section. 



III. INFLUENCE OF HYBRIDIZATION 

Wave functions of gapless electron states on a surface 
of strong three-dimensional TI decay exponentially in 
the bulk with characteristic depth of the order of sev- 
eral nanometers [2^, [3(| ■ In sufficiently thin films over- 
lap of wave functions of the states belonging to opposite 
surfaces of the film can occur. This results in avoided 
crossing of dispersions of these states manifesting itself 



A, K 




T, K 



FIG. 5: (Color online) Conceptual example of behavior of the 
gap A (solid line) as a function of temperature T in a system 
with hybridization at fj. = 0.1 eV, A = 0.15 and At = 0.3 K. 
The initial hybridization gap At (dashed line) and the BCS 
gap calculated without hybridization (dotted line) are shown 
for comparison. 



as opening of the hybridization gap At- This gap in 
the spectrum is rather similar to the gap which could be 
opened by the pairing (see Fig. [2]). 

Indeed, the order parameter of the electron-hole pair- 
ing is (dp 6_p), where is destruction operator for 

(2) 

electron with momentum p on the top surface and 6_ p is 
destruction operator for hole with the opposite momen- 
tum — p on the bottom surface. Electron-hole transfor- 
mation implies that = ftp 2 ^, where a p 2 ' + is creation 
operator for electron with momentum p on the bottom 
surface. 

Therefore the pair of operators entering the order pa- 
rameter (ap 1 ' ) 6^ 2 p )=(ap 1 ' , ap 2 ' )+ ) is analogous to that de- 
scribing the process of momentum-conserving electron 
tunneling between top and bottom surfaces. Thus the 
gap equation for the total energy gap in the mean field ap- 
proximation, describing both the pairing and hybridiza- 
tion, differs from ([!]) by the additional term At in the 
right-hand side: 



A(p) = A T 



dp' 1 + COs(<^9 — if') 



(27T)* 



nip-p'i 



x^-tanh« 
2E(p') 2T 



(9) 



It is seen from © that the total gap A becomes larger 
than hybridization gap At due to the pairing. We shall 
solve Eq. ©, similarly to Eq. (gj), in the BCS-like ap- 
proximation ([S"]l. 

In Fig. [S]the example of solution of Eq. (JSJ is plotted 
under conditions when the hybridization gap At is ap- 
proximately 10 times smaller than the zero-temperature 
BCS gap Aq calculated without hybridization. In the 
absence of hybridization, the gap A would vanish at some 
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critical temperature, but nonzero hybridization makes A 
always nonzero and larger than At- At T = the total 
gap is drastically increased even by weak hybridization 
- due to nonlinearity of Eq. it is larger than just 
a sum At + Aq CS ; at T — > oo the gap gradually tends 
to At- Thus the hybridization leads to the smearing of 
a phase transition into the paired state in close analogy 
with behavior of a ferromagnet in external magnetic field. 

How can we observe the pairing in the presence of hy- 
bridization? Besides possible superfluid signatures of the 
pairing (see the Conclusions) , we can still detect increase 
of the gap in the spectrum when the temperature is low- 
ered — from the purely hybridization value At at high 
temperatures to a somewhat larger value A at zero (or 
very low) temperature (Fig. [SJ . To be observable, this in- 
crease should be relatively large, i.e. Ao — At should not 
be very small in comparison with At- In addition, the in- 
crease of the gap should occur in reasonably narrow tem- 
perature range. This range can be estimated by a char- 
acteristic temperature T c h a r at which the gap is halfway 
between A T and A , i.e. A(T char ) - A T = [A - A T ]/2. 

For calculations we take the data on hybridization gaps 
in Bi2Se3 films from the experiment |25j, where the film 
thickness d ranges from 2 to 5 QL, and from the theoreti- 
cal paper (29|, where d ranges from 1 to 16 QL (the close 
results for At were also presented in the earlier paper 
HHl). It should be noted that in the overlapping region 
of d from 2 to 5 QL the experimental gaps from [25| are 
several times larger than the calculated gaps from (29j . 
probably due to some impurities enhancing the interlaycr 
tunneling. 

According to these data, we take several examples of 
Bi2Se3 films with different d and At- We take At = 
0.126 eV at d = 2QL and A T = 0.02 eV at d = 5 QL 
from [25l ] as examples of large hybridization gaps (keeping 
in mind that the actual gap in the spectrum reported 
in the literature is 2At). As examples of small gaps, 
A T = 6 x 10~ 4 eV at d = 5 QL and A T = 5 x 10~ 5 eV at 
d = 8 QL are taken from [2!| . 

The aforementioned characteristics of the pairing with 
hybridization are shown in Fig. [5] for these four exam- 
ples of Bi 2 Se3 films at e\ — £3 = 1. The gap calculated 
with hybridization is several orders of magnitude larger 
than the BCS gap. In the cases of strong hybridization at 
small d (Fig. |5)[a,b)), the increase of the total gap above 
the purely hybridization gap At, being negligible com- 
pared with At itself and occurring in a range of several 
thousands Kelvins, can hardly been observed. However 
when the hybridization is rather weak (Fig. [B£c,d)) the 
gap can grow significantly (up to several times) when we 
lower the temperature by several tens of Kelvins. In this 
case the gap itself is not larger than several Kelvins. 

We can conclude that the temperature-dependent 
growth of the total gap is appreciable only if the hy- 
bridization is sufficiently weak, i.e. in moderately thin 
films. Since the gap itself becomes too small in thicker 
films, the optimal thickness for observing the pairing is 
about 5-8 QL. 
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FIG. 6: (Color online) Characteristics of the pairing in sus- 
pended Bi2Se3 films with hybridization: increase Ao — At 
of the total gap (solid line) above the hybridization gap 
At (long-dashed line), characteristic temperature range T c h ar 
(dotted line) at which the gap increases, and BCS gap Aq CS 
(short-dashed line) calculated without hy bridization. The 
data on hybridization are taken from [25|] for d = 2 QL (a) 
and 5 QL (b), and from [H for d = 5 QL (c) and 8 QL (d). 



IV. INFLUENCE OF DISORDER 

As known, charged impurities supp ress an electron- 
hole pairing in two-layer system 0[5j[53| since they, be- 
ing usually uncorrelated in two layers, break the Cooper 
pairs by differently scattering two pair constituents. Ac- 
cording to the Abrikosov-Gor'kov theory, applied to the 
case of electron-hole pairing, the Gor'kov equations re- 
main the same as in the case of clean system, but with 
Matsubara frequencies ui n and gaps at these frequencies 
A„ renormalized in the following way: 



LJ n = LO n + (711 + 722) 



A„ -> A„ = A - 2 7 i 



LU 2 + A 2 



= , (10) 



where u n = TtT(2n + 1) and A are initial Mathubara 
frequencies and gap. The quantities 7^ correspond to 
intralayer (711 and 722 for top and bottom surfaces re- 
spectively) and interlayer (712) correlation functions of 
random impurity potential. 

The gap equation ^ for disordered system takes the 
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form: 



10 4 



XT 



E 

n= — oo 



(ii) 



When 711 + 722 + 2712 = 0, the impurities do not affect 
the result of energy integration and frequency summation 
in (jlip and thus the pairing characteristics remain the 
same. In superconductors it corresponds to the case of 
nonmagnetic impurities which, according to the Ander- 
son theorem, do not suppress the pairing. In two-layer 
system this situation requires perfect anticorrelation of 
impurity potential between the layers and thus is hardly 
realizable in practice. 

In reality, when a range of impurity potential signif- 
icantly exceeds a film thickness (the limit d — > 0) and 
both surfaces of the film are equally disordered, we have 
7n = 722 = 712 = 27, where 7 is electron damping 
rate. For further calculations we consider the opposite 
case of short-range impurities and relatively thick films 
(d — > 00), when 711 = 722 = 27, 712 = 0. 

We can estimate 7 on the basis of the data on surface 
carrier mobilities /i c determining the surface conductivity 
of TI, expressed through the Drude formula: 



nefi c 



2 

en 

4-7T7 ' 



(12) 



where n = /i 2 /47r«p is the surface carrier concentration. 
In experiments on surface transport on Bi2Se3 (see the 
references cited on pp. 1088-1089 of the review |2j) the 
measured mobilities vary from ~ 100 to ~ 20000 cm 2 /V- 
s. For calculations we choose the example of dirty sample 
where fi c — 500 cm 2 /V-s and the example of clean sample 
with He = 10 4 cm 2 /V • s. 

In usual Abrikosov-Gor'kov theory, the pair-breaking 
disorder reduces both the gap and critical temperature, 
and sufficiently strong disorder can suppress the pairing 
completely. In our case the total gap A is always larger 
than the hybridization gap At- However in the pres- 
ence of disorder their difference A — At diminishes in 
comparison with that in clean system. 

In Fig. [7] the increase of the gap A — At calculated 
numerically from <jTUJ) — ([TTJ) is plotted at different disor- 
der strengths for different examples of suspended Bi 2 Sc 3 
films. It is seen that disorder rather weakly affects the 
pairing at strong hybridization (Fig. EJa)) since the gap 
is very large in this case. At weak hybridization, when 
the effect of the pairing on the gap is expected to be most 
pronounced, even moderate disorder drastically reduces 
A — At (Fig. [7fc,d)). Therefore we can conclude that 
the temperature-dependent increase of the gap due to 
the pairing can be observed only in very clean (with car- 
rier mobilities fi c > 10 4 cm 2 /V • s) and moderately thin 
(5-8 QL) TI films. 
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FIG. 7: (Color online) Increase Ao — At of the zero temper- 
ature total gap above the hybridization gap with no disorder 
(solid line), at fi c = 10 4 cm 2 /V • s (short-dashed line) and at 
/i c = 500cm 2 /V-s (dotted line). The hybridization gap (long- 
dashed line) in Bi2Se3 films is taken from [2^] for d — 2QL 
(a) and 5QL (b), and from Q for d = 5 QL (c) and 8QL 
(d). 



V. SUPPRESSION OF SCREENING 

In the previous sections we have considered the pair- 
ing potential screened by dielectric environment and by 
metallic electron and hole gases on two surfaces of the 
film. However this consideration is not completely self- 
consistent since the film becomes insulating on the sur- 
face due to appearance of the gap in the spectrum. When 
the gap is very large (especially in the case of strong hy- 
bridization) the screening by electron and hole gases can 
substantially differ from that in metallic system. In this 
case we should take into account self-consistent weaken- 
ing of the screening caused by the pairing (the similar 
effect was considered earlier for semiconductor quantum 
wells [47} and graphene bilayer (4ll.[58j'). 

When the gap A appears in the system due to inter- 
layer pairing or hybridization, the intralayer static polar- 
izabilities IIn and n22 are no longer equal to the intrin- 
sic polarizability Ho and can be expressed in RPA as (see 
41, 58]) 
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FIG. 8: (Color online) Phase diagram of the pairing (without 
hybridization) in Bi2Se3 film at different dielectric constants 
of surrounding medium ei = £3 and different dimensionless 
thicknesses p?d. The regions when the gap equation at T = 
gives one small gap, three gaps and one large gap are shown. 
Inset: typical behavior of solutions A of the gap equation at 
£l,£3 < 4.5. 



where p' = p + q, ip and tp' are azimuthal angles of 
the momenta p and p', 7,7' = ±1 are indices denoting 
the conduction (+1) and valence (—1) bands (i.e. up- 
per and lower parts of the double Dirac cone), E V1 = 
\J (jvpp — ^i) 2 + A 2 is the energy of Bogolyubov excita- 



tion in the band 7. The coherence factors u pl and 
are positive and determined by the equations: 



in 



pi 



1 7«fP — M 

2 + 



2E. 



in 



- in 



2E. 



(14) 



in 



In a two-layer system, interlayer pairing or hybridiza- 
tion also leads to appearance of the anomalous polariz- 
ability II12 describing direct response of charge density 
in one layer on electric field in the other layer. In RPA 
it can be calculated as 



IIi2(g) = .9 



E 

77' 



dp 1 + 77' cos(tp — tp') 



(27T) 2 



2 i/ 



E„ 



E, 



■pry I 



(15) 



We performed numerical solving of the gap equation 
(O with taking into account hybridization and with the 
pairing potential (H}-© self-consistently screened by 
electrons and holes with the polarizabilities (ITUl) . (fL3j). 
In this case the usual BCS method ([5]) which reduces the 
pairing potential to a single coupling constant A is inap- 
plicable since the integral in (|8]) diverges due to absence 
of long-range screening in the gapped system. Thus we 



A, K 



A, K 




10" 



0.05 0.1 

li, eV 
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FIG. 9: (Color online) Increase Ao — At of the zero tempera- 
ture total gap in suspended Bi2Se3 films above the hybridiza- 
tion gap with (solid line) and without (short-dashed line) tak- 
ing into account self-consistent suppression of the screening. 
The hybridization gap (long-dashed line) in Bi2Se3 films is 
taken from [25| for d — 2 QL (a) and 5 QL (b), and from [2^] 
for d = 5 QL (c) and 8 QL (d). 



perform full integration of (j3J over momentum p' in the 
region \vpp' — n\ < w where A(p') 7^ 0. 

Our calculations show that at sufficiently weak cou- 
pling the gap is several times larger than in the case of 
metallic screening. At stronger coupling two additional 
solutions of the gap equation appear, which are by sev- 
eral orders of magnitude larger than the small gap that 
existed at weak coupling. Only the maximal of the result- 
ing three gaps, providing the lowest ground state energy, 
will be established in the system. At further increase of 
the coupling (say, decrease of p^d) two smallest solutions 
disappear and only one large gap remains (see the inset 
in Fig.©. 

In Fig. |5] we show the phase diagram of Bi2Se3 film 
at T = with self-consistent weakening of the screening 
but without hybridization. At nonzero hybridization the 
regions of one large gap and of three solutions in this di- 
agram would grow in size. At nonzero temperature the 
smallest gap gradually vanishes at small critical tempera- 
ture (as in usual BCS model), but two largest gaps disap- 
pear at much larger temperature abruptly from nonzero 
values to zero, which is characteristic of the first-order 
phase transition (this fact was also noted in [41]). 

In Fig. [S]we demonstrate that Ao — At becomes larger 
in several times at strong hybridization (Fig. [9ja,b)) 
and by the order of magnitude at weaker hybridization 
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(Fig-Efcjd)) in comparison with the results obtained with 
metallic screening. Our predictions for observability of 
the pairing become more optimistic, when we treat the 
screening self-consistently, especially for relatively thick 
films with weak hybridization, where even sharp transi- 
tion to a strongly-correlated state can occur (Fig. EJd)). 

VI. CONCLUSIONS 

We have considered the pairing of spatially separated 
massless Dirac electrons and holes created on opposite 
surfaces of TI thin film by antisymmcrtic doping. The 
main advantage of such system over two-layer graphene 
system is four times smaller degeneracy of electron states 
leading to much weaker screening and much larger cou- 
pling constants. The effect of large bulk dielectric con- 
stant of the TI itself on the pairing can be negligible when 
the film is sufficiently thin. 

Our calculations in BCS approximation show that the 
pairing gap is large enough to be observable when the 
film thickness is less than 15 nm. In this case, however, 
tunneling between opposite surfaces leads to hybridiza- 
tion of electron and hole states. Such hybridization, on 
the one hand, effectively increases the gap. On the other 
hand, the pairing can become hardly observable on back- 
ground of strong hybridization. 

We show that the pairing causes increase of the total 
gap in the spectrum above the purely hybridization gap 
when the temperature is decreased. This effect can be 
observed only in moderately thin films (about 5-8 QL for 
Bi2Ses) where the hybridization is rather weak and effect 
of the pairing is noticeable on its background. Another 
way to observe the pairing can be based on measuring 
of change of the gap with varying surface electron and 
hole chemical potentials. Charged impurities and other 
disorder on surfaces of the film suppress the pairing, so as 
it can be observed only in sufficiently clean TIs (surface 
carrier mobility should be at least 10 4 cm 2 /V • s by the 
order of magnitude) . 

Also we have demonstrated that BCS approximation, 
by assuming the metallic screening by surface carri- 
ers, underestimates the coupling strength since the real 
screening in the gapped system is much weaker. The 
self-consistent treatment of the screening demonstrates 



that the gap can be by orders of magnitude larger than 
given by BCS model, and observation of the pairing in 
TI films can turn out to be more feasible. Multi-band 
and dynamical effects can additionally increase the gap. 

Realization of electron-hole pairing in TI thin film is 
a difficult task including chemical doping of TI bulk to 
insulating state and, at the same time, doping of two op- 
posite surfaces to electron- and hole-metallic states by 
means of gate electrodes or charged impurities. Another 
challenge is fabrication of separate contacts to the sur- 
faces. However considerable progress achieved recently in 
experimental studies of TIs and TI thin films (see 0, [|[ 
and references therein) gives hope that conditions suit- 
able for the electron-hole pairing can be reached in near- 
est years. In particular, transport measurements in a 
regime of coexistence of electrons and holes on opposite 
surfaces of Bi2Se3 film were carried out in Ref. [64| . 

In this article, we considered only the manifestation of 
the pairing in the temperature dependence of the gap 
in the spectrum. For exciton condensate in electron- 
hole bilayers, such signatures as dipolar superfluidity (45j . 
Josephson-like effects [45l. I48L I63L l65j ] , peculiarities of the 
drag effect KM pQL |67| and anomalous electromagnetic 
response |68l. l69jwere predicted. Strong hybridization 
occurring in thin TI films imposes serious limitations on 
observability of these phenomena. As known, the tunnel- 
ing in electron-hole bilayer leads to fixation of the con- 
densate phase and to absence of uniform dipolar super- 
fluidity. However the superfluidity can arise locally in a 
form of Josephson-like vortices [63|, [65| or vortex lattice 
[48j . In the latter case the dipolar current flowing along 
the bilayer should exceed some critical value in order for 
the vortex lattice to be stable. At high enough tempera- 
ture the vortex lattice undergoes a dislocation-mediated 
melting when pairs of edge dislocations dissociate and 
proliferate (see |48j). It is interesting to note that dis- 
location ends in this case are topologically equivalent to 
vortices in a superfluid condensate and thus can settle 
Majorana zero energy modes [34j which can be manipu- 
lated for the purpose of quantum computations. 
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